
SPECIFICATION 



PORTABLE VIEWING/LISTENING SYSTEM 
TECHNICAL FIELD 

5 The present invention relates to portable viewing/listening systems, and more 

particularly to a portable viewing/listening system in which program data that is received by a 
fixedly or semi-fixedly installed main device is transferred to an easy-to-carry portable device 
so as to be played-back in the portable device and thereby provide a user of the portable 
device with the program data. 

10 BACKGROUND ART 

Thanks to multi-channeled broadcast and developing video services through 
communications, the number of programs which are available for general users has been 
increasing. However, the users' spare-time for watching the programs is limited within a day. 
Accordingly, the users cannot always watch every program that they are interested in. 

15 Recently, a portable viewing/listening system which enables the users to watch 

programs in their spare time (during lunch or in transit) has been proposed. A conventional 
portable viewing/listening system is constituted by a main device which is installed in a 
house and an easy-to-carry portable device. The main device is at least capable of receiving 
program data that is provided through broadcasting, internally-storing the received program 

20 data, and transferring the stored program data to the portable device. 

The conventional portable viewing/listening system, however, takes a long time to 
transfer the program data from the main device to the portable device. Accordingly, if the 
users run out of time and thus stop data transfer halfway through, the program data is not 
entirely transferred, and thus the users cannot enjoy the entire program. 

25 FIG. 1 8 is a diagram illustrating a data transfer mode which is adopted in the 



I 



conventional portable viewing/listening system. Hereinafter, by referring to FIG. 18, 
problems that are associated with the conventional system are described in more detail. 

FIG. 18(a) shows a time transition of data constituting a program to be broadcast. In 
FIG. 1 8 (a) , a lateral axis indicates a lapse of time during broadcast, and a vertical axis 
5 indicates a bit rate during broadcast, respectively. To be more specific, FIG. 18 (a) shows that 
Program 1 is broadcast between Time tO and Time tl, Program 2 is broadcast between Time 
tl and Time t2, and Program 3 is broadcast between Time t2 and Time t3, respectively. The 
Program 1, Program 2, and Program 3 are respectively provided with audio, closed caption, 
and video as program components (mono-media constituting a program). For the sake of 

10 clarity, it is herein assumed that a length of broadcast time for the Program 2 (t2 - tl) is equal 
to the length of broadcast time for the Program 3 (t3 - 12), and a length of broadcast time for 
the Program 1 (tl - tO) is exactly twice the length of broadcast time for the Program 2 (or the 
Program 3) . It is also assumed that a bit rate for the respective program components remains 
invariant no matter which Program, and thus a ratio among a bit rate of closed caption be, bit 

15 rate of audio ba, and bit rate of video by is always 1:2:4. 

FIG. 18(b) shows a time transition which takes place when the program data is 
transferred from the main device to the portable device in the conventional portable 
viewing/listening system. In FIG. 18 (b) , a lateral axis indicates a lapse of time in a data 
transfer operation, and a vertical axis indicates a bit rate during transfer, respectively. As 

20 shown in FIG. 18(b), transfer of the program components of the Program 1, Program 2, and 
Program 3 is completed between Time t4 and Time t9. In FIG. 18(b), unlike the bit rate 
during broadcast shown in FIG. 18 (a) , the bit rates for the program components during 
transfer are each compressed or extended in the direction of a time axis according to 
characteristics of data for the respective program components. However, the program 

25 components herein are basically transferred in the same order as those during broadcast. This 



means that every program component of the Program 1 is transferred between Time t4 and 
Time tT*, every program component of the Program 2 is transferred between Time t7 and 
Time t8, and every program component of the Program 3 is transferred between Time t8 and 
Time t9, respectively. A ratio among (t7 - 14) , (t8 - 17) and (t9 - 18) , all of which indicate a 
5 length of time which is taken to transfer each Program, is 2: 1 : 1 . This is equal to the ratio 
among (tl - tO), (t2 - tl) and (t3 - 12) , all of which indicate a length of broadcast time for each 
Program. Assuming that a total bit rate for closed caption, audio and video during transfer is a 
-time as much as a total bit rate during broadcast, a ratio between a length of broadcast time 
of a certain program and a length of time which is taken to transfer the program is always a:l. 
10 FIG. 18(c) shows a case where a transfer of program data is discontinued halfway at 

Time to in the conventional portable viewing/listening system. In this example, the Time ta is 
assumed to satisfy t7 < /a < t8. As transfer of the program data is discontinued in the middle 
of the Program 2 between Time t7 and Time t8, the entire data of the Program 1 and a partial 
amount of the data of the Program 2 from its beginning to Time ta is transferred to the 
15 portable device. However, as to the remaining portion of the data of the Program 2 and the 
entire data of the Program 3, none of the program components, i.e., closed caption, audio and 
video, included therein is transferred to the conventional portable viewing/listening system. 
As to the not-transferred part of data, the portable device does not inform the users what the 
non-transferred data is. Therefore, the users cannot even know whether or not the non- 
20 transferred data is interesting enough to watch. 

SUMMARY OF THE INVENTION 
Therefore, an object of the present invention is to provide a portable viewing/listening 
system which guarantees the minimum play-back quality that is required for the users on the 
portable device side even when data transfer from the main device to the portable device is 
25 discontinued in a short time. 

3 



The present invention has the following features to attain the object described above. 
A first aspect of the present invention is directed to a portable viewing/listening 
system in which program data that is received by a fixedly or semi-fixedly installed main 
device is playedback in an easy-to-carry portable device so as to provide a user with the 
5 program data. 

The main device of the first aspect comprises: 

receiving means for receiving program data that is provided through 

broadcasting; 

primary storing means for storing the program data received by the receiving 

10 means; 

transfer priority assigning means for assigning transfer priorities to each 
program component constituting the program data that is stored in the primary storing means; 
and 

transferring means for discretely transferring, to the portable device, each of 
15 the program components of the program data that is stored in the primary storing means in 
the direction of a time axis in the order of the assigned transfer priorities. 
The portable device of the first aspect comprises: 

secondary storing means for storing the program components to be discretely 
transferred from the transferring means; 
20 re-constructing means for re-constructing program data included in any 

program that is desired to played-back from the program components which are stored in the 
secondary storing means; and 

playing-back means for playing-back the program data that is re-constructed 
by the re-constructing means. 
25 As described above, in the first aspect, each program component constituting the 



program data simultaneously received by the main device is assigned a transfer priority, and 
the program components are discretely transferred, to the portable device, in the direction of 
the time axis in the order of the assigned transfer priorities. Therefore, even if data transfer 
from the main device to the portable device is discontinued in a short time (i.e., prematurely), 
5 there is a high possibility that some of the program components are entirely transferred to the 
portable device. Accordingly, the users can enjoy, albeit incomplete, the entire program by 
playing-back the already-transferred program components. 

According to a second aspect of the present invention, in accordance with the first 
aspect, the transfer priority assigning means assigns transfer priorities to each of the program 

10 components in such a manner that a program component with a smaller amount of data has a 
higher transfer priority. 

As described above, in the second aspect, any program component having a smaller 
amount of data has a higher transfer priority from the main device to the portable device. This 
means that a length of time which is taken to transfer the program component having the 

15 higher transfer priority is shorter. Consequently, if data transfer is presumably discontinued in 
the system of the present invention and in the conventional one at the same time, the number 
of program components which are successfully transferred to the portable device in the 
system of the present invention is larger. 

According to a third aspect of the present invention, in accordance with the second 

20 aspect, the main device further comprises transfer priority defining means for previously 
defining transfer priorities by default to every type of the program components, and the 
transfer priority assigning means assigns, in accordance with a definition provided by the 
transfer priority defining means, the transfer priorities by default to each of the program 
components. 

25 As described above, in the third aspect, each of the program components is assigned. 



in the main device, the transfer priorities by defauh according to the type thereof. Therefore, 
the program components can be transferred in an order which is appropriately determined by 
the characteristics thereof 

According to a fourth aspect of the present invention, in accordance with the third 
5 aspect, when the plurality of program data stored in the primary storing means are 

collectively transferred to the portable device, the transferring means selects any program 
component having the same transfer priority from each of the program data, combines the 
selected program components into a unit, and then discretely transfers the combined unit in 
the direction of the time axis in the order of the transfer priorities that are assigned to every 

10 combined unit. 

As described above, in the fourth aspect, when a plurality of program data is 
collectively transferred to the portable device, the data is not transferred on a program basis 
but instead on a transfer priority basis. That is, the program components having the same 
transfer priority are selected from the respective program data, the selected program 

15 components are combined to a unit, and then the combined unit is transferred in the order of 
the transfer priorities which are assigned to every combined unit. Therefore, the programs are 
assigned transfer priorities in a fair manner, and as a result, variation in arriving time of the 
programs can be prevented. 

According to a fifth aspect of the present invention, in accordance with the fourth 

20 aspect, types of the program components are classified into a plurality of classes by the 

transfer priority defining means. Further, the transfer priority assigning means checks every 
class for the transfer priorities by default which are assigned to each of the program 
components, and then changes, in accordance with a result of the check, the transfer priorities 
by default which are assigned to each of the program components on a class basis, as 

25 required. 



As described above, in the fifth aspect, the types of the program components are 
classified into a plurality of classes, and the transfer priorities are checked on a class basis 
before making a change, if any. Therefore, the transfer priorities can be managed on a class 
basis. 

5 According to a sixth aspect of the present invention, in accordance with the fifth 

aspect, when no program component in the same class has a value which is defined as being a 
top transfer priority therein, the transfer priority assigning means changes a value of a 
program component being currently the highest transfer priority in the class to the value 
which is defined as being the top priority therein. 

10 As described above, in the sixth aspect, even if the types of the program components 

in the same class are varying, some of the program components are managed to reach the 
portable device when the first unit for each class is transferred. 

According to a seventh aspect of the present invention, in accordance with the first 
aspect, the main device further comprises program component generating means for 

15 generating a new program component from the program components of the program data 
received by the receiving means, and the storing means adds the program component that is 
newly generated by the program component generating means to the program data received 
by the receiving means and stores the same. 

As described above, in the seventh aspect, another program component can be newly 

20 generated from the received program components and transferred. It is effective for a case 
where the received program data is hierarchically encoded into a plurality of layers so that the 
program components in the respective layers are transferred, or for a case where the received 
detailed video is decimated to generate and transfer a non-detailed video. 

According to an eighth aspect of the present invnetion, in accordance with the first 

25 aspect, when any data of the program component of the program data that is re-constructed 



by the re-constructing means is discontinued halfway during play-back by the playing-back 
means, .the portable device further comprises replacing means for having any other program 
component being not currently played-back to play-back as a replacement. 

As described above, in the eighth aspect, the program component which was not 
5 entirely played-back due to the discontinued data transfer is replaced by any other program 
component to be played-back. Therefore, the users can enjoy the entire program. 
According to a ninth aspect, in the eighth aspect, the program component which was not 
entirely played-back due to the discontinued data transfer is replaced by any other program 
component to play-back. Therefore, the users can enjoy the entire program. 
10 According to a ninth aspect of the present invention, in accordance with the eighth 

aspect, 

the protable device further comprises prentation priority defining means for 
previously defining presentation priorities to each type of the program components, andthe 
replacing means determines a program component to be played-back as a replacement in 
15 accordance with the definition that is provided by the presentation priority defining means. 

As described above, in the ninth aspect, the portable device is set to determine the 
program component as a replacement in accordance with the presentation priorities which are 
defined to every type of the program components. Therefore, the program components can be 
replaced to be played-back in an order which is suitably determined by the characteristics 
20 thereof 

According to a tenth aspect of the present invention, in accordance with the ninth 
aspect, types of the program components are classified into a plurality of classes by the 
presentation priority defining means, andthe replacing means determines a program 
component to be played-back as a replacement from among the program components 
25 belonging to the same class as does the program component discontinued during play-back. 



As described above, in the tenth aspect, the replacing order to be played-back can be 
managed on a class basis. 

According to an eleventh aspect of the present invention, in accordance with the first 
aspect, the main device and the portable device are structured to be electrically 
5 interconnectable, and the transferring means online-transfers each program component of the 
program data that is stored in the primary storing means directly to the portable device. 

As described above, in the eleventh aspect, the main device and the portable device 
are electrically interconnectable. Consequently, program data can be transferred on-line. 

According to a tw^elfth aspect of the present invention, in accordance with the 
10 eleventh aspect, the main device further comprises attaching means for allowing the portable 
device to be electrically connected, andcharging means for supplying power to charge the 
portable device when the portable device is attached to the attaching means. Further, 
according to the twelfth aspect the portable device also comprises a battery to be charged by 
the power which is supplied from the charging device. 
15 As described above, in the twelfth aspect, transfer of the program data and charging of 

the portable device can be done at the same time. 

According to a thirteenth aspect of the present invention, in accordance with the first 
aspect, the transferring means offline-transfers each program component of the program data 
that is stored in the primary storing means to the portable device through a recording 
20 medium. 

As described above, in the thirteenth aspect, data can be off-line transferred from the 
main device to the portable device through a recording medium. Therefore, such a structure 
eases restrictions which are imposed on the physical layout of the main device and the 
portable device. Furthermore, a plurality of recording media will increase a substantial 
25 memory capacity. 



According to a fourteenth aspect of the present invention, in accordance with the 
thirteenth aspect, the main device further comprises writing means for writing any program 
component to be transferred to the portable device into the recording medium, andthe 
portable device further comprises reading means for reading the program component that is 
5 recorded in the recording medium. 

According to a fifteenth aspect of the present invention, in accordance with the first 
aspect, the receiving means receives program data through a computer network. 

A sixteenth aspect of the present invention is directed to a main device which is used 
in a state of being fixedly or semi-fixedly installed, and which is used to transfer any received 
10 program data to an easy-tocarry portable device. The main device of the sixteenth aspect 
comprises: 

receiving means for receiving program data that is provided through broadcasting; 
primary storing means for storing the program data received by the receiving means; 
transfer priority assigning means for assigning transfer priorities to each program 
15 component constituting the program data that is stored in the primary storing means; and 
transferring means for discretely transferring, to the portable device, each of the 
program components of the program data that is stored in the primary storing means in the 
direction of a time axis in the order of the assigned transfer priorities. 

As described above, in the sixteenth aspect, each of the program components 
20 constituting program data simultaneously received is assigned a transfer priority, and the 
program components are discretely transferred, to the portable device, in the direction of the 
time axis in the order of the assigned transfer priorities. Therefore, even when data transfer to 
the portable device is discontinued in a short time, some of the program components may 
possibly be entirely transferred thereto. Accordingly, the users can enjoy the whole program, 
25 albeit incomplete, by playing-back the already-transferred program components. 



According to a seventeenth aspect of the present invention, in accordance with the 
sixteenth aspect, the transfer priority assigning means assigns transfer priorities to each 
program component in such a manner that a program component with a smaller amount of 
data has a higher transfer priority. 
5 As described above, in the seventeenth aspect, any program component having a 

smaller amount of data has the higher transfer priority. This means that a length of time 
which is taken to transfer the program component having the higher transfer priority is 
shorter. Consequently, if data transfer is presumably discontinued in the system of the present 
invention and in the conventional one at the same time, the number of program components 
10 that are successfully transferred to the portable device in the system of the present invention 
is larger. 

According to an eighteenth aspect of the presnet invention, in accordance with the 
seventeenth aspect, the main device further comprises transfer priority defining means for 
previously defining transfer priorities by default to each type of the program components, 
15 andthe transfer priority assigning means assigns the transfer priorities by default to each of 
the program components in accordance with a definition which is provided by the transfer 
priority defining means. 

As described above, in the eighteenth aspect, each of the program components is 
assigned the transfer priorities by default according to the type thereof Therefore, the 
20 program components can be transferred in an order that is appropriately determined by the 
characteristics thereof. 

According to a nineteenth aspect of the present invention, in accordnace with the 
eighteenth aspect, when the plurality of program data stored in the primary storing means are 
collectively transferred to the portable device, the transferring means selects any program 
25 component having the same transfer priority fi-om each of the program data, combines the 



selected program components into a unit, and then discretely transfers the combined unit in 
J:he direction of the time axis in the order of the transfer priorities which are assigned to every 
combined unit. 

As described above, in the nineteenth aspect, when a plurality of program data are 
5 collectively transferred to the portable device, the data is not transferred on a program basis 
but instead on a transfer priority basis. That is, the program components having the same 
transfer priority are selected from the respective program data, the selected program 
components are combined to a unit, and then the combined unit is transferred in the order of 
the transfer priorities which are assigned to every combined unit. Therefore, the programs are 

10 assigned transfer priorities in a fair manner, and as a result, variation in arriving time of the 
programs can be prevented. 

According to a twentieth aspect of the present invnetion, in accordance with the 
nineteenth aspect, types of the program components are classified into a plurality of classes 
by the transfer priority defining means. Further, the transfer priority assigning means checks 

15 every class for the transfer priorities by default which are assigned to each of the program 
components, and then changes, in accordance with a result of the check, the transfer priorities 
by default which are assigned to each of the program components on a class basis, as 
required. 

As described above, in the twentieth aspect, the types of the program components are 
20 classified into a plurality of classes, and the transfer priorities are checked on a class basis 
before making a change, if any. Therefore, the transfer priorities can be managed on a class 
basis. 

According to a twenty-first aspect of the present invention, in accordance with the 
twentieth aspect, when no program component in the same class has a value which is defined 
25 as being a top transfer priority therein, the transfer priority assigning means changes a value 



of a program component being currently the highest transfer priority in the class to the value 
.which is defined as being the top priority therein. 

As described above, in the twenty-first aspect, even when the types of the program 
components in the same class are varying, some of the program components are managed to 
5 reach the portable device when the first unit for each class is transferred. 

According to a twenty-second aspect of the present invention, in accordance with the 
sixteenth aspect, the main device further comprises program component generating means for 
generating a new program component from the program components of the program data 
received by the receiving means. Further, according to the twenty-second aspect, the storing 
10 means adds the program component that is newly generated by the program component 

generating means to the program data received by the receiving means, and stores the same. 

As described above, in the twenty-second aspect, another program component can be 
newly generated from the received program components and is transferred. It is effective for 
a case where the received program data is hierarchically encoded into a plurality of layers so 
15 that the program components in the respective layers are transferred, or for a case where the 
received detailed video is decimated to generate and transfer a non-detail video. 

A twenty-third aspect of the present invention is directed to a portable device for 
receiving and playing-back program data that is received by a fixedly or semi-fixedly 
installed main device so as to provide a user of the portable device with the received program 
20 data. The portable device of the twenty-third aspect comprises: 

secondary storing means for storing each program component of the program data to 
be discretely transferred from the main device; 

re-constructing means for re-constructing program data of a program that is desired to 
be played-back from the program components stored in the secondary storing means; and 
25 playing-back means for playing-back the program data that is re-constructed by the 



re-constructing means. 

.As described above, in the twenty-third aspect, in a case where the program 
components of the program data are discretely transmitted from the main device, the program 
data that is included in any program which is desired to be played-back can be re-constructed 
5 from the received program components and is played-back. 

According to a twenty-fourth aspect of the present invention, in accordance with the 
twenty-third aspect, when data of the program component of the program data which is re- 
constructed by the re-constructing means is discontinued halfway during play-back by the 
playing-back means, the portable device further comprises replacing means for having any 
10 other program component being not currently played-back to be played-back as a 
replacement. 

As described above, in the twenty-fourth aspect, the program component which was 
not entirely played-back due to a discontinued data transfer is replaced by any other program 
component to be played-back. Therefore, the users can enjoy the entire program. 

15 According to a twenty-fifth aspect of the present invention, in accordance with the 

twenty-fourth aspect, the portable device further comprises presentation priority defining 
means for previously defining presentation priorities to each type of the program 
components, andthe replacing means determines a program component to be played-back as a 
replacement in accordance with a definition which is provided by the presentation priority 

20 defining means. 

As described above, in the twenty-fifth aspect, the portable device is set to determine 
the program component as a replacement in accordance with the presentation priorities which 
are defined to every type of the program components. Therefore, the program components 
can be replaced to be played-back in an order which is suitably determined by the 

25 characteristics thereof. 



According to a twenty-sixth aspect of the present invention, in accordance with the 
.twentyrfifth aspect, types of the program components are classified into a plurality of classes 
by the presentation priority defining means, andthe replacing means determines a program 
component to be played-back as a replacement from among the program components 
5 belonging to the same class as does the program component that is discontinued during play- 
back. 

As described above, in the twenty-sixth aspect, the replacing order to be played-back 
can be managed on a class basis. 

A twenty-seventh aspect of the present invention is directed to a method of 
10 transferring program data that is received by a fixedly or semi-fixedly installed main device 
to an easy-to-carry portable device. The method comprises the steps of: 

receiving program data that is provided through broadcasting; 

storing the received program data; 

assigning transfer priorities to each program component constituting the stored 
15 program data; and 

discretely transferring, to the portable device, each of the program components of the 
stored program data in the direction of a time axis in the order of the assigned transfer 
priorities. 

As described above, in the twenty-seventh aspect, each program component 
20 constituting the program data that is simultaneously received by the main device is assigned a 
transfer priority, and the program components are discretely transferred, to the portable 
device, in the direction of the time axis in the order of the assigned transfer priorities. 
Therefore, even if data transfer from the main device to the portable device is discontinued in 
a short time (i.e., prematurely), there is a high possibility that some of the program 
25 components are entirely transferred to the portable device. Accordingly, the users can enjoy. 



albeit incomplete, the entire program by playing-back the alreadytransferred program 
.components. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a block diagram showing the structure of a portable viewing/listening system 
according to a first embodiment of the present invention. 

FIG. 2 is a diagram exemplarily showing a storage list which is stored in a memory 
112 in a main device 1 shown in FIG. 1. 

FIG. 3 is a flowchart illustrating an operation that is performed on the main device 
side when program data is transferred from the main device 1 to a portable device 2 in the 
portable viewing/listening system of the first embodiment of the present invention. 

FIG. 4 is a flowchart illustrating a detailed operation of a subroutine step SI 03 in the 
flowchart of FIG. 3. 

FIG. 5 is a diagram exemplarily showing a transfer priority table which is stored in 
the memory 112 in the main device 1 shown in FIG. 1. 

FIG. 6 is a diagram exemplarily showing a receipt list which is stored in a memory 
208 in the portable device 2 shown in FIG. 1. 

FIG. 7 is a flowchart illustrating an operation of the portable device 2 when receiving 
program data that is transferred from the main device 1 in the portable viewing/listening 
system of the first embodiment of the present invention. 

FIG. 8 is a flowchart illustrating how the portable device 2 is operated to play-back a 
program in the portable viewing/listening system of the first embodiment of the present 
invention. 

FIG. 9 is a diagram exemplarily showing a class table which is stored in the memory 

208 in the portable device 2 shown in FIG. I. 

FIG. 10 is a diagram illustrating how data is transferred in the portable 

16 



viewing/listening system in FIG. 1. 

,FIG. 1 1 is a diagram showing a time transition which takes place during a program 
transfer in a case where data to be transferred includes a digest video in the portable 
viewing/listening system in FIG. 1. 
5 FIG. 12 is a diagram exemplarily showing a storage list to be generated when the 

received data includes a digest video in the main device 1 in FIG. 1. 

FIG. 13 is a diagram exemplarily showing a receipt list to be generated when the data 
that is transferred from the main device 1 includes a digest video in the portable device 2 in 
FIG. 1. 

10 FIG. 14 is an outer perspective diagram showing the physical structure of a portable 

viewing/listening system according to a second embodiment of the present invention. 

FIG. 15 is a block diagram showing the electric structure of the portable 
viewing/listening system according to the second embodiment of the present invention. 

FIG. 16 is an outer perspective diagram showing the physical structure of a portable 
15 viewing/listening system according to a third embodiment of the present invention. 

FIG. 17 is a block diagram showing the structure of a portable viewing/listening 
system according to a fourth embodiment of the present invention. 

FIG. 1 8 is a diagram illustrating a data transfer system which is adopted in a 
conventional portable viewing/listening system. 
20 DETAILED DESCRIPTION OF THE INVENTION 

Outline of the System 

The portable viewing/listening system described in the following embodiments is 
constituted by a main device which is fixedly or semi-fixedly installed in a house and an 
easy-to-carry portable playing-back device (hereinafter, referred to as a portable device). The 
25 main device includes at least a function of receiving (in some cases, a function of playing- 



back is included) program data that is provided through broadcasting (both broadcast 
.transmitted over radio waves, and broadcast transmitted through a cable transmission path are 
included), a function of internally storing the received program data, and a function of online- 
transferring or offline-transferring the stored program data to the portable device. To online- 
5 transfer any selected program data, the portable device is connected to the main device. The 
portable device then internally stores the program data that is transferred from the main 
device, and plays-back the stored program data at the users' convenience. On the other hand, 
to offline-transfer the program data, the main device once writes the internally stored 
program data to a recording medium (video tape, rewritable optical disk, solid memory card, 
10 and the like). After the writing, the recording medium is detached from the main device and 
is then attached to the portable device. Accordingly, in this case, the portable device reads 
any desirable program data from the attached recording medium and then plays-back the 
same. 

A distinctive characteristic of the system of the present invention lies in a method of 
15 transferring data from the main device to the portable device. Specifically, this system 
discretely transfers data fi-om the main device to the portable device. As described in the 
foregoing, one program data is generally constituted by a plurality of program components 
(video, audio, closed caption, for example). As these program components are being 
concurrently played-back, the program components are conventionally transferred to the 
20 portable device at one time. On the other hand, in this system, every program component 
constituting one program data is assigned a transfer priority so as to be discretely transferred 
in the direction of a time axis according to the given order of priorities. 

With such data transfer being discretely executed, some of the program components 
may possibly be entirely transferred to the portable device even if data transfer from the main 
25 device to the portable device is discontinued in a short time (i.e., prematurely). Therefore, the 



users can enjoy the entire program, albeit incomplete, by playing-back the already-transferred 
.program components. In the aforementioned conventional portable viewing/listening system, 
however, none of the program components of the program data is entirely transferred if data 
transfer to the portable device is discontinued in a short time. As a result, the users cannot 
5 enjoy the entire program. 
First Embodiment 

FIG. 1 is a block diagram showing the structure of a portable viewing/listening system 
according to a first embodiment of the present invention. In FIG. 1, the portable 
viewing/listening system of the first embodiment includes a main device 1 and a portable 

10 device 2. The portable device 2 is detachable/attachable from/to the main device 1 . 

The main device 1 includes an antenna 101, a receiving part 102, a demultiplexing 
part 103, an additional information generating part 104, a storage information generating part 
105, a storage managing part 106, a storage part 107, a connection interface 109, a user input- 
output part 1 10, a decoder 1 1 1, a memory 112, and a CPU 113. 

15 The receiving part 102 includes a tuner and a demodulator which are constituents of a 

typical digital broadcast receiver. The receiving part 102 receives a broadcast wave that is 
received by the antenna 101, and outputs a digital stream. Video information, audio 
information, additional information and the like are multiplexed into the digital stream. A 
specific format for the digital stream may be MPEG-2 TS (Transport Stream), for example. 

20 Note that MPEG-2 TS, and multiplexing by MPEG-2 TS are standardized by the international 
standard of MPEG-2 Systems. 

The demultiplexing part 103 is constituted by a TS processor, for example, and 
separates the digital stream that is outputted from the receiving part 102 into the video 
information, the audio information, the additional information, and the like. When the digital 

25 stream is MPEG-2 TS, the demuhiplexing part 103 classifies TS packets being the smallest 



unit of the digital stream according to values of packet ID (pid) which are written in TS 
. packet headers so as to separate the multiplexed video information, audio information, 
additional information, and the like. 

The additional information generating part 104 receives information that is relevant to 
5 the additional information from among the information that is included in the digital stream 
which is separated by the demultiplexing part 103 so as to generate additional information. A 
format for the additional information is a section format defined in DVB-SI being the 
international standard, for example. In DVB-SI, a method of transmitting information which 
is relevant to a broadcast channel (pid, for example) and information which is relevant to an 

10 EPG (Electric Program Guide) is defined as a data format based on the section format. The 
information relevant to the EPG, for example, is transmitted in the section format called EIT 
(Event Information Table). To transmit information in the section format, information to be 
transmitted is divided into a certain size or smaller, and is repeatedly transmitted. In this 
manner, the additional information generating part 104 collects and merges the divided 

15 information into one data, and updates the information if the contents thereof have been 
changed. 

The storage information generating part 105 converts the video information and audio 
information that are inputted from the demultiplexing part 103 into a format which is suitable 
for storing in the storage part 1 07, and then outputs the converted information to the storage 

20 managing part 106. The storage information generating part 105 also generates both detailed 
video information and non-detailed video information in accordance with the video 
information that is inputted from the demultiplexing part 103 as is required. The non-detailed 
video information is of inferior image quality to the detailed video information but has a 
smaller amount of data. Accordingly, the non-detailed video information is done with a 

25 transfer processing that is quicker than the detailed video information. 



Both detailed video information and non-detailed video information are generated in 
,the storage information generating part 105 in a first case where the CPU 1 13 instructs the 
storage information generating part 105 to generate the non-detailed video information. If this 
is the case, the storage information generating part 105 outputs the video information that is 
5 inputted from the demultiplexing part 103 as detailed video information in its current form. 
Further, the storage information generating part 105 changes the resolution of the video 
information that is inputted from the demuhiplexing part 103 or intermittently decimates 
frames thereof so as to generate and output the non-detailed video information. 

Both detailed video information and non-detailed video information are generated in 

10 the storage information generating part 105 in a second case where the video information that 
is inputted from the demultiplexing part 103 includes the non-detailed video information as 
well as the detailed video information from the beginning. There may be a case where the 
received video information is hierarchically encoded or a case where the received video 
information is transmitted in a hierarchical transmission mode, for example. If this is the 

15 case, the video information that is inputted from the demultiplexing part 103 is multi-layered 
in varying image qualities, and the upper layer has the more codes and the better image. In 
this manner, the storage information generating part 105 outputs the video information that is 
included in the top layer as detailed video information without any change. Further, the 
storage information generating part 105 outputs the video information that is included in the 

20 lower layer as non-detailed video information. To generate video information corresponding 
to the respective layers, a method of selecting layers which is used in the typical digital 
broadcast receiver can be used as it is. 

The storage information generating part 105 outputs the aforementioned non-detailed 
video information to the storage managing part 106 as video information for a digest video. 

25 Accordingly, the CPU 1 1 3 manages the non-detailed information which is stored in the 



storage part 107 as the video information for the digest video. Note that, in the first 
.embodiment, the detailed information and non-detailed information are generated only for 
video. However, the detailed information and non-detailed information may be generated for 
audio as well depending on the particular situation. 
5 The storage managing part 106 and the storage part 107 are interconnected, and the 

storage managing part 106 controls information writing and reading with respect to the 
storage part 107 under the control of the CPU 113. The storage part 107 is constituted by a 
relatively large-capacity storage device using a hard disk or DVD-RAM, for example. The 
storage part 107 stores program data. 

10 The connection interface 109 is used to physically and electrically connect the main 

device 1 to other devices, and to transmit video, audio or other digital information from/to the 
other devices. Such a connection interface 109 may be a typical input-output interface for 
digital information including an interface of IEEE1394. 

The user input-output part 110 receives inputs from the users or presents the users in 

15 which state the device is. Such a user input-output part 1 10 is exemplarily constituted by an 
infrared remote controller, remote control photoreceiving part, pilot lamp, and the like. 
Information is presented to the users also through a GUI operation utilizing OSD (On Screen 
Display) that is included in the video information outputted from the decoder 1 1 1. In this 
case, the users push buttons which are provided for the remote controller while observing the 

20 OSD, for example, so as to play-back or erase stored programs, or preselect or transfer 
programs. 

The memory 1 12 stores various information relating to the operation of the main 
device 1 . To be more specific, the memory 1 12 stores program information that is used to 
execute operation control of the main device 1, additional information that is outputted from 
25 the additional information generating part 104, and storage management information that is 



used to manage the information stored in the storage part 107, for example. 

, The CPU 1 13 and other constituents which are provided in the main device 1 are 
interconnected, and the CPU 1 1 3 executes the program information that is stored in the 
memory 1 12 so as to collectively control those constituents. 
5 The portable device 2 includes a connection interface 201, a portable 

viewing/listening information managing part 202, a storage part 203, a decoder 204, a display 
205, a speaker 206, a user input-output part 207, a memory 208, and a CPU 209. 

The connection interface 201 is physically and electrically connected to the 
connection interface 109 in the main device 1, and is used to receive video, audio and other 
10 digital information from the main device 1 . Such a connection interface 201 may be a typical 
input-output interface for digital information including the interface of IEEE1394. 

The portable viewing/listening information managing part 202 and the storage part 
203 are interconnected. The storage part 203 is constituted by a storage device using a hard 
disk, DVD-RAM, or solid memory, for example. Since the storage part 203 is installed in the 
15 portable device 2, it is preferred that the storage part 203 be downsized. The storage part 203 
stores program data to be transferred from the main device 1 . 

The decoder 204 receives and decodes the program data which is stored in the storage 
part 203 so as to convert the data into analog video/audio signals. The display 205 is 
constituted by a liquid crystal display or a small-sized CRT display, for example, and 
20 receives the analog video signals that are outputted from the decoder 204 so as to display the 
corresponding image thereon. The speaker 206 receives the analog audio signals that are 
outputted from the decoder 204 so as to output the corresponding audio therefrom. 

The user input-output part 207 receives inputs from the users, and presents the users 
in which state the device is. Such a user input-output part 1 10 is exemplarily constituted by 
25 an infrared remote controller, remote control photoreceiving part, pilot lamp, and the like. 



Information is also presented to the users through the GUI operation utilizing an OSD which 
, is displayed on the display 205. In this case, the users push buttons which are provided for the 
remote controller while observing the OSD, for example, so as to set to play-back or erase 
stored programs, or preselect or transfer programs. 
5 The memory 208 stores various information that is relevant to an operation of the 

portable device 2. In detail, the memory 208 stores program information which is used to 
execute operation control of the portable device 2, storage management information which is 
used to manage the information stored in the storage part 203, and the like. 

The CPU 209 and other constituents in the portable device 2 are interconnected, and 
10 the CPU 209 executes the program information which is stored in the memory 208 so as to 
collectively control these constituents. 

FIG. 2 is a diagram exemplarily showing the structure of a storage list to be stored in 
the memory 1 12 of the main device 1. This storage list is data for managing the program data 
which is stored in the storage part 107 of the main device 1, and is tablestructured. 
15 Specifically, each line of the table represents a single program component for a particular 
program. The storage list of FIG. 2 exemplarily shows that the storage part 107 stores eight 
program components in total. Each line of the table includes four attributes of event id, type, 
size, and transfer priority. 

The attribute "event id" is attribute information for identifying the programs. In this 
20 example, for the sake of simplicity, event id for the Program 1, Program 2 and Program 3 are 
assumed to be 0x0001, 0x0002, 0x0003, respectively. Herein, "Ox" indicates that a 
hexadecimal digital follows. 

The attribute "type" is attribute information for single program component for 
identifying the types of program components. Characters "C", "A", and "V" which are found 
25 in the storage list of FIG. 2 respectively represent Closed Caption, Audio and Video. Digest 



video represented by "D" is further included therein. This will be described later. 

. The attribute "size" indicates a size of the area in the storage part 107 that is occupied 
by the corresponding program component. A size unit herein may simply be a bite, or a block 
which is represented by the number of blocks in a given size. 
5 The attribute "transfer priority" is attribute information which is used to determine in 

which order the program components are transferred when the program data is transferred 
from the main device 1 to the portable device 2. In this example, the smaller value has the 
higher priority. 

Among the attributes in FIG. 2, when the program is received, event id, type and size 
10 can be obtained from the information that is transmitted as additional information for the 
program. The transfer priorities are established when the transfer processing of at least one 
program is executed. 

FIG. 3 is a flowchart illustrating an operation which is executed on the main device 
side when the program data is transferred from the main device 1 to the portable device 2 in 
15 the portable viewing/listening system of the first embodiment. The processing of FIG. 3 is 
realized when the CPU 113 in the main device 1 executes the program information which is 
stored in the memory 1 12 in the main device 1. Hereinafter, by referring to FIG. 3, the 
operation whereby the main device 1 transfers the program data to the portable device 2 is 
described. 

20 First, the CPU 113 selects a first program from among the programs which are stored 

in the storage part 107 (step SlOl) . The storage list (see FIG. 2) which is stored in the 
memory 1 12 is referred to so as to know what programs are stored in the storage part 107. 
Taking the storage list of FIG. 2 as an example, "Program 1" is the program to be selected 
first from the stored data of the Program 1, Program 2, and Program 3. Thereafter, the CPU 

25 1 13 judges whether or not any program was selected in step SI 01 (step 5102) . In this 



example, since "Program 1" was selected in step 5101, the CPU 1 13 goes to step SI 03. 

, In step SI 03, the CPU 1 13 sets transfer priorities for each program component 
constituting the program that is selected in step SlOl. For details of this subroutine step SI 03, 
see FIG. 4. 

5 By referring to FIG. 4, the CPU 113 sequentially selects the program components 

constituting the target program (first "Program 1 " in this example) that is selected in step 
SI 01 (step S201) . Thereafter, the CPU 1 13 judges whether or not any program component 
was selected in step S201 (step S202) . If yes, the CPU 1 13 provides the program component 
that is selected in step S201 with an applicable default value which is predetermined for 

10 every type of program components as a transfer priority (step S203). 

FIG. 5 shows a transfer priority table in which the default values indicating the 
transfer priorities for each type of the program components are defined. The transfer priority 
table of FIG. 5 is stored in the memory 1 12, for example. In FIG. 5, as an example, the 
default values of 1, 2, 3 and 4 as transfer priorities are respectively assigned to the types C, A, 

15 D and V. The transfer priority table of Fig. 5 has a class which is defined for each type. The 
class herein shows the classified types of program components. Preferably, data that is 
replaceable with each other is classified into the same class. For example, audio can be 
replaced by closed caption, and detailed video can be replaced by digest video. In step S203, 
the CPU 113 first refers to the transfer priority table of FIG. 5, and then sets transfer priorities 

20 by default for every program component in the storage list of FIG. 2. 

After step S203 is performed, the CPU 1 13 returns to step S201 and selects the next 
program component for the target program. Thereafter, the CPU 113 assigns a transfer 
priority for the selected program component by referring to the transfer priority table of FIG. 
5 (step S203). 

25 After steps S201 to S203 are repeated, and after each program component constituting 



the target program is assigned a transfer priority, the program components to be selected in 
. step S201 would have all been gone by then. Therefore, the CPU 1 13 determines that no 
program component was selected in step S202, and advances to step S204. 

In step S204, the CPU 1 13 selects the classes that are defined in the transfer priority 
5 table of FIG. 5 in the given order. In this example, two classes of "script" and "display" are 
defined in the transfer priority table of FIG. 5. Accordingly, in step S204, either one of the 
"script" or "display" is initially selected, the other one is selected second, and a third 
selection results in no class being selected. Thereafl:er, the CPU 1 13 judges whether or not 
any class was selected in step S204 (step 5205) . If yes, the CPU 113 then judges whether or 

10 not the program component that is defined in the selected class as being a top transfer priority 
is included in the target program (step S206). By referring to the transfer priority table in 
FIG. 5, for example, one of the program components which is classified in the class of 
"script" is in type "C" with a transfer priority of "1", and the other program component is in 
type "A" with a transfer priority of "2". It means, in the class of "script", the program 

15 component in type "C" is defined as being the top priority. Similarly, as to the program 

components which are classified in the class of "display", the program component in type "D" 
is assigned with a transfer priority of "3", and thus is defined as being the top priority in the 
class of "display". Therefore, according to the definition of the transfer priority table of FIG. 
5, in step S206, the CPU 1 13 judges whether or not the target program includes any program 

20 component in type "C" when the currently selected class is "script". On the other hand, when 
the currently selected class is "display", the CPU 1 13 judges whether or not the target 
program includes any program component in type "D". 

When the target program has no program component which is defined as being the top 
transfer priority in the selected class, the CPU 1 13 selects any program component having the 

25 highest transfer priority next to the top priority, and updates the priority value thereof to a 



value which is defined as being the top priority in the class (step S207) . In a case where the 
, class of "script" is currently selected and each program component that is included in the 
target program is in type "A", the transfer priority for the program component in type "A" is 
updated from the default value of "2" to "1", which is defined as being the top priority in the 
5 class. Similarly, in a case where the class of "display" is currently selected and each program 
component that is included in the target program is in type "V", the transfer priority for the 
program component in type "V" is updated from the default value of "4" to "3", which is 
defined as being the top priority in the class. Each update in step S207 is reflected in the 
storage list of FIG. 2. That is, any applicable transfer priority for the program component in 

10 the storage list is updated. Thereafter, the CPU 1 13 returns to step S204. Note that, when the 
target program has any program component which is defined as being the top transfer priority 
in the selected class, the CPU 113 returns to step S204 without updating any transfer priority. 

Next, the CPU 1 13 selects the next class from the transfer priority table of FIG. 5, 
refers to the transfer priority that is defined for the respective types in the selected class, and 

15 judges whether or not defauh transfer priorities for each program component that is included 
in the target program should be updated. If yes, the CPU 1 13 updates the applicable values to 
the predetermined ones. 

After steps S205 to S207 are repeated, and after the processing is done with every 
class, the classes to be selected in step S204 would have all been gone by then. Thus, the 

20 CPU 1 13 determines that no class was selected in step S205, terminates the subroutine 
processing in FIG. 4, and then returns to the main routine processing in FIG. 3. 

Referring back to FIG. 3, the CPU 113 selects the next program from the storage list 
of FIG. 2 (step SlOl) , and assigns transfer priorities for each program component 
constituting the selected program (step S103) . After steps S 101 to S 103 are repeated, and 

25 after every program in the storage list is assigned a transfer priority, the CPU 113 judges that 



there is no program to select next (step SI 02), and then advances to step SI 04. 

. In step SI 04, the CPU 113 initially sets a count value N of a counter which indicates a 
transfer priority (hereinafter, refers to as transfer priority counter) to a value of "1" indicating 
the top transfer priority (step SI 04). Then, the CPU 1 13 judges whether or not the count 
5 value N of the transfer priority counter is 5 (step S105) . Herein, four values of 1, 2, 3 and 4 
are available as transfer priorities in the transfer priority table in FIG. 5. Therefore, if N = 5, it 
means that every transfer priority is completely assigned. Since N = 1 at the beginning, the 
CPU 1 13 determines that N ^ 5, and then advances to step SI 06. 

In step SI 06, the CPU 113 selects one program component whose transfer priority is 

10 N (at the beginning, N = 1) from the storage list of FIG. 2. Thereafter, the CPU 1 13 judges 
whether or not any program component was selected in step SI 06 (step S107) . If yes, the 
CPU 1 13 takes out the attribute information of "event id", "type", and "size" from the line of 
the storage list corresponding to the program component which is selected in step SI 06, and 
then transfers the same to the portable device 2 (step S108) . Then, the CPU 113 takes out 

15 main data of the program component which is selected in step SI 06, and transmits the same 
to the portable device 2 (step S109) . Thereafter, the CPU 113 returns to step SI 06, selects 
another program component whose transfer priority is N from the storage list of FIG. 2, and 
then executes the transfer processing for the selected program component. 

After steps SI 06 to SI 09 are repeated, and after each program component having the 

20 transfer priority of N is completely transferred, the CPU 1 1 3 judges that all the program 

components to be selected in step SI 06 are gone (step SI 07), increments the count value N of 
the transfer priority counter by 1 (step SI 10) , and then returns to step S105. Then, the CPU 
1 1 3 executes the transfer processing for the program component having the transfer priority 
of N (N = 2) after the count value N of the transfer priority counter is updated. 

25 After steps SI 05 to SI 09 are repeated, and after the transfer processing is done with 



every program component having the transfer priorities of 1 to 4, N = 5. Thus, the CPU 113 
, judges that the transfer processing is completely done in step SI 05, and then terminates the 
processing. 

FIG. 6 shows the structure of a receipt list which is to be stored in the memory 208 in 
5 the portable device 2. The receipt list is data that is used to manage how the data which is 
stored in the storage part 203 in the portable device 2 (that is, program data that is transmitted 
from the main device 1) is stored, and is table-structured. The lines of the table are in a one- 
to-one correspondence with the program components that are stored in the storage part 203. 
Also, each line of the table has six attributes including receipt order, off set, size, eventid, 

10 type, and length of play-back time. 

The attribute "receipt order" indicates the order in which the portable device 2 
receives the data of the program components from the main device 1, and a value does not 
appear more than once in the receipt list. Thus, the receipt order can be used as a key for 
specifying lines of the receipt list. 

15 The attribute "offset" indicates where the program components being in the one-to- 

one correspondence with the lines of the receipt list are located in the data that is received 
from the main device 1 . When transfer of the entire program from the main device 1 to the 
portable device 2 is presumably considered a bit stream or a file, the attribute "offset" 
represents the number of bites from the beginning of the transfer. The value of the offset can 

20 be represented simply in a bite or the number of blocks in a given size similar to the case 
where the attribute "size" in the storage list of FIG. 2 matters. 

The attribute "size" represents a size of an area in the storage part 203 of the portable 
device 2 which is occupied by the program components being in the one-to-one 
correspondence with the lines of the receipt list. The attribute "size" is also represented in a 

25 similar unit to the attribute "offset". 



The attribute "event_id" is attribute information that is used to identify to which 
, program the program components being in the one-to-one correspondence with the lines of 
the receipt list respectively belong. 

The attribute "type" is attribute information that is used to identify the types of the 
5 program components being in the one-to-one correspondence with the lines of the receipt list. 

The attribute "length of play-back time" represents the length of play-back time when 
the program components being in the one-to-one correspondence with the lines of the receipt 
lines are played-back under the same conditions. When data transfer is interrupted halfway 
through for some reason, the number of bites of the transferred data is less than the number of 
10 bites of the same program component which is broadcast. In such a case, the length of play- 
back time is assigned a length of time corresponding to the transferred data. 

FIG. 7 is a flowchart illustrating how the portable device 2 is operated to receive 
program data that is transmitted from the main device 1 in the portable viewing/listening 
system of the first embodiment. The processing in FIG. 7 can be realized when the CPU 209 
15 in the portable device 2 executes program information which is stored in the memory 208 in 
the portable device 2. Through the processing, the program data that is transmitted from the 
main device 1 is stored in the portable device 2, and the receipt list of FIG. 6 is also 
generated. Hereinafter, referring to FIG. 7, how the portable device 2 is operated to receive 
the program data transmitted from the main device 1 will be described. 
20 First of all, the CPU 209 initializes the receipt list of FIG. 6 (step S301) . The easiest 

way of initializing the receipt list is done by deleting every line thereof and, at the same time, 
deleting the program data that is stored in the storage part 203 in the portable device 2. 
Thereafter, the CPU 209 assigns a value of 0 to a variable current_offset, and assigns a value 
of 1 to a variable send_count (step S302). Then, the CPU 209 receives the attribute 
25 information of "'size", "event id", and "type" to be transmitted from the main device 1 (step 



S303). Such attribute information is the one that is transmitted in step SI 08 in FIG. 3. The 
. CPU 209 then judges whether or not there is any data to receive in step S303 (step S304) . If 
not, the CPU 209 terminates the operation, but if yes, the CPU 209 then judges whether or 
not an available region of the storage part 203 is sufficiently large for the value of the "size" 
5 which is obtained in step S303 (step S305) . If yes, the CPU 209 goes to step S306, but if not, 
the CPU 209 returns to step S3 03. 

In step S306, the CPU 209 adds a line to the receipt list of FIG. 6, and then assigns 
values which are obtained in step S303 to each corresponding attribute "size", "event id", or 
"type" in the added line. Thereafter, the CPU 209 assigns the value of the variable 

10 current offset to the attribute "offset" in the added line (step S307) . The CPU 209 adds the 
value of "size" which is obtained in step S303 to the variable current_offset (step S308) , and 
then assigns the value of the variable send_count to the attribute "receipt order" in the added 
line (step S309) . The CPU 209 then increments the value of the variable send count by 1 
(step 53 10) . After performing step S3 10, the CPU 209 receives the main data of the program 

15 components that are transmitted from the main device I, and then stores the same in the 

storage part 203 (step S31 1) . Then, the CPU 209 sets the attribute "'length of play-back time" 
(step S3 12). Herein, it is assumed that the main data of the program components itself 
includes, as additional information, a bit rate value indicating the number of data bit per unit 
presentation time. In this case, to convert the value of the "size" which is obtained in step 

20 S303 to the length of play-back time, the value of the "size" is divided by the bit rate that is 
obtained in the aforementioned manner. Note that, the value of the length of program time 
can be notified directly from the main device 1 as data as in the case with the "size", for 
example. Next, the CPU 209 judges whether or not a receipt of program data is discontinued 
halfway through for some reason (step S313) . If yes, the CPU 209 advances to step S3 14, but 

25 if no, the CPU 209 returns to step S303. Such discontinuation may include a case, for 



example, where the users abruptly disconnect the portable device 2 from the main device 1, 
, and vice versa. 

In step S3 14, the CPU 209 finds a value of the attribute "size" in the receipt list from 
the size of the program component which is actually stored in the storage part 203, and resets 
5 the value (step S3 14). Then, the CPU 209 obtains, in a similar manner to step S3 12, a value 
for the length of play-back time from the value of the attribute "size" in the receipt list, and 
then resets the "length of play-back time" in the receipt list (step S315) . Then, the CPU 209 
terminates the processing for receiving. 

FIG. 8 is a flowchart illustrating how the portable device 2 is operated to play-back 
10 the program. This processing can be realized when the CPU 209 executes the program 
information which is stored in the memory 208 in the portable device 2. Hereinafter, by 
referring to FIG. 8, how the portable device 2 is operated to play-back the program will be 
described. 

First, a description of a class table that is used to play-back the program is as follows. 

15 FIG. 9 is an exemplary class table. The class table is, for example, stored in the memory 208, 
and the CPU 209 is at liberty to access the class table. As shown in FIG. 9, lines of the class 
table are in a one-to-one correspondence with the types of the program components, and each 
line has three attributes of "type", "class", and "presentation priority". 

In FIG. 9, the attribute "class" shows the classified types of the program components. 

20 By taking this class table as an example, two classes of "script" and "display" are defined 
therein. The first and second lines thereof show that closed caption and audio are instances 
belonging to the same class of "script", and the third and fourth lines thereof show that digest 
video and detailed video are instances belonging to the same class of "display". The attribute 
"presentation priority" defines in which order the program components in varying types 

25 classified into the same class should be presented to the users. In this example, the smaller 
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value has the higher presentation priority. Such class table is referred to to search for some 
, other .program components for replacement when the program component being played-back 
is interrupted halfway. 

By referring to FIG. 8, the CPU 209 first executes displaying and selecting operation 
5 of the programs (step S401). To be more specific, the CPU 209 generates a list of the 
programs stored in the storage part 203 by referring to the receipt list of FIG. 6, and then 
displays the generated list on the display 205. Thereafter, the CPU 209 let the users select any 
program which is desired to be played-back from the displayed list. The selection of the 
programs is done through the user input-output part 207. When it is desired for the list of the 

10 programs displayed on the display 205 to include titles of the programs as well, data 
indicating the title-to-"event_id" relationship may be sent along with the titles during 
transmission of the program data from the main device 1 to the portable device 2. For such 
data indicating the relationship, additional information to be transmitted through broadcasting 
for the EPG (Electric Program Guide) may be used. Next, the CPU 209 extracts, from the 

15 receipt list, each program component of the program which is selected in step S401 to be 

played-back (step S402). Thereafter, the CPU 209 generates a list of the program components 
constituting the selected program according to the extraction result in step S402, and then 
displays the generated list on the display 205 (step S403) . In response thereto, the users 
select one or more program component (s) to be played-back from the displayed list. The 

20 selection of the program components is done through the user input-output part 207. Then, 
the CPU 209 makes a preparation for concurrent play-back of all of the program components 
which are selected in step S403 (step S404) . By concurrently playing-back the program 
components, lip synch can be attained, for example, which is synchronization between a 
speaker's lip movements in the video and audio. 

25 Thereafter, the CPU 209 executes a play-back processing of the program components 



which are prepared in step S404 (step S405). The CPU 209 then judges whether or not any 
, play-back position of the program components being played-back has reached to a tail (end) 
of the data (step S406) . There may be a case where the data is completely played-back, or a 
case where the data is interrupted. If none of the play-back positions of the program 
5 components has reached to the tail, the CPU 209 returns to step S405 so as to continue the 
play-back processing. On the other hand, if any play-back position of the program 
components has reached to the tail, the CPU advances to step S407. 

In step S407, the CPU 209 selects any other program component in the same class as 
the program component whose play-back position has reached to the data tail but in different 

10 type in the order of presentation priorities that are defined in the class table of FIG. 9. To be 
more specific, the CPU 209 first extracts every program component constituting the program 
that is being played-back from the receipt list of FIG. 6, and then selects, from among the 
extracted program components, any program component belonging to the same class as the 
program component whose play-back position is judged to have reached to the data tail in 

15 step S406. Thereafter, the CPU 209 takes out any program component, from among the 

selected program components, whose presentation priority is lower than the one whose play- 
back position has reached to the data tail, and then selects the type of the program component 
whose presentation priority is the highest from among the taken-out program components. 
When the play-back position of the program component in type "V" presumably reaches to 

20 the data tail during play-back, the CPU 209 selects the type "D", which is in the same class of 
"display" as the type "V" and which has the presentation priority lower than the type "V" but 
the highest among the rest. 

Thereafter, the CPU 209 judges whether or not any type is selected in step S407 (step 
S408) . If yes, the CPU 209 then judges whether or not the program component in the type 

25 which is selected in step S407 is already being played-back (step S409). This first 



embodiment takes a structure where the users can simultaneously select, in step S403, a 
plurality of program components in varying types which are classified into the same class. 
Therefore, the program component in the type which is selected in step S407 may possibly be 
already being played-back. For example, if the play-back position of the program component 
5 in type "V" reaches to the data tail when the program components in type "D" and "V" are 
concurrently being played-back, the data of the program component in type "D" is selected 
instep S407 as described above. In such a case, the CPU 209 returns to step S405 so as not to 
repeatedly play-back the program component in the same type, and thus does not replace the 
interrupted program component with others to be played-back. On the other hand, if the 

10 program component in the type which is selected in step S407 is not yet played-back, the 
CPU 209 replaces the interrupted program component with the program component in the 
selected type to be played-back (step S410) . In this case, the CPU 209 does not start playing- 
back from the beginning of the program component in the type selected in step S407. 
Instead, the CPU 209 starts playing-back from the continued part of the interrupted program 

15 component. In this example, closed caption and audio are in the same class. Even if the data 
of audio is interrupted, closed caption thus may take the place by being playing-back from the 
interrupted part. In this manner, the users can enjoy the program not with audio but with 
closed captions. Thereafter, the CPU 209 returns to step S405. 

On the other hand, when no type was selected in step S408, the CPU 209 determines 

20 that there is no more component to replace to play-back, and then terminates the play-back 
processing for the class (step S41 1) . This may happen when the users have selected the type 
having the lowest presentation priority. Also, this may happen when the target program is 
completely played-back. At this time, the CPU 209 changes a value of a flag variable 
indicating the play-back processing being executed on the class basis into a value indicating 

25 the processing being terminated. Then, the CPU 209 judges whether or not the program 



component being played-back is completely played-back. This judgement is made by 
. refeiring to the value of the aforementioned flag variable. If any program component is still 
being played-back in whatever the class, the CPU 209 returns to step S405 so as to continue 
the play-back processing for other classes. On the other hand, if the target program is 
5 completely played-back, the program components being played-back in each class are 
terminated. Thus, the CPU 209 terminates the play-back processing of the program. 

FIG. 10 is a diagram illustrating how data is transferred in the portable 
viewing/listening system of FIG. 1. Hereinafter, how data is transferred in the portable 
viewing/listening system of FIG. 1 will be described in detail. 

10 FIG. 10 (a) shows a time transition of data constituting the program to be broadcast. 

In FIG. 10 (a) , a lateral axis indicates a lapse of time during broadcast, and a vertical axis 
indicates a bit rate during broadcast, respectively. In detail, FIG. 10 (a) shows that the 
Program 1 is broadcast between Time tO and Time tl, the Program 2 is broadcast between 
Time tl and Time t2, and the Program 3 is broadcast between Time t2 and Time t3, 

15 respectively. Further, the Program 1, Program 2, and Program 3 are respectively provided 
with audio, closed caption, and video as a program component (mono-media constituting the 
program). For the sake of simplicity, the length of broadcast time for the Program 2 (t2 - tl) 
and the length of broadcast time for the Program 3 (t3 - 12) are equal, and the length of 
broadcast time of the Program 1 (tl - tO) is exactly twice the length of broadcast time for the 

20 Program 2 (or Program 3). Further, a bit rate for the respective program components remains 
invariant no matter which program, and thus, a ratio among a bit rate of closed caption be, a 
bit rate of audio ba, and a bit rate of video bv is always 1:2:4. 

FIG. 10(b) shows a time transition which takes place when program data is transferred 
from the main device 1 to the portable device 2. In FIG. 10 (b) , a lateral axis indicates a 

25 lapse of time for a data transfer operation, and a vertical axis indicates a bit rate during 



transfer, respectively. It is assumed that transfer is started at Time t4 as in the conventional 

system shown in FIG. 1 8 (b) . As the total number of bits to be transferred is equal to the 

example in FIG. 18, the data is completely transferred at Time t9 as is in the conventional 

system. In FIG. 10 (b) , each closed caption part of the programs to be transferred (Program 

5 1, Program 2, and Program 3) is first transferred between Time t4 to Time t5, each audio part 

thereof is then transferred between Time t5 to Time t6, and lastly each video part thereof is 

transferred between Time t6 to Time t9. As described above, the rate among the program 

components of closed caption, audio, and video during broadcast is 1:2:4. Therefore, the 

length of time which is taken to transfer closed caption of the programs (t5 - 14) , the length 

10 of time which is taken to transfer audio thereof (t6 - 15) , and the length of time which is 

taken to transfer video thereof (t9 - 16) are respectively expressed by the following equations 

(1), (2) and (3). 

(t5 - 14) = (t9 - 14) 

X{l/(l+2 + 4)} ...(1) 

15 (t6 - 15) = (t9 - 14) 

X {2/(1 +2 + 4)} ...(2) 

(t9 - 16) = (t9 - 14) 

X{4/(l+2 + 4)} ...(3) 

Further, t6 can be represented by the following equation (4). 

20 t6 = t4 + [(t9 - 14) 

X {(1 + 2)7(1+2 + 4)}] ...(4) 

FIG. 10(c) shows, in the portable viewing/listening system in FIG. 1, a case where the 

transfer of program data is interrupted at Time ta. In this example. Time to presumably 

satisfies t6 < to < t9. Even if the transfer of the program data is discontinued halfway through 

25 at Time ta, audio components and closed caption components for the respective programs are 
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completely transferred by then. At this stage, in the portable device, the programs are not 
available in video but in closed caption and audio. This means that the users can be informed 
of the contents thereof to some extent. In other words, the users can enjoy every program 
with closed caption and audio, although not with video. In a practical sense, the bit rates of 
5 the closed caption and audio are rather high as compared to bit rates of the video. In this 
sense. Time t6 when every closed caption component and audio component are completely 
transferred possibly comes at much earlier timing than Time 9 when the program is entirely 
transferred with the video components. In particular, the length of time which is required for 
transferring the video (t9 - 16) is rather long as compared to the length of time which is for 

10 transferring the closed caption components and the audio components (t6 - 14). Therefore, the 
audio components may highly-possibly be entirely transferred even if transfer is stopped in a 
rather short time. Further, as is transferred in text, the bit rate of the closed caption 
components can be lowered to a greater extent than the bit rate of the audio components. 
Therefore, transfer of the closed caption components can be completed much quicker than the 

15 transfer of the audio components. 

FIG. 1 1 shows a time transition which takes place to transfer the program in a case 
where data to be transferred includes a digest video in the portable viewing/listening system 
in FIG. 1. The case herein is somewhat complicated as compared to the case in FIG. 10. 
FIG. 1 1 (a) shows a time transition for information of the program to be broadcast. 

20 This example herein is different from the example in FIG. 10(a) in that the Program 1 
includes a digest video Dl in a detailed video VI, and the Program 2 does not include a 
closed caption C2. The bit rate without the closed caption C2 is assigned to a detailed video 
V2, and thus, the detailed video V2 is increased by the closed caption C2 as much as the 
other programs. 

25 FIG. 1 1(b) shows a time transition which takes place when the program is transferred. 



First of all, by taking transfer started at Time t4 as an example, information that is sufficient 
^ to play-back every program to some extent is transferred by Time tlO . This means that 
closed caption is transferred to the Programs 1 and 3, and audio is transferred to the Program 
2. Note that the program components to be transferred between Time t4 to Time 10 are the 
5 ones having the transfer priority of 1 in the storage list of FIG. 12. 

Thereafter, the program components in the "script" class which are not transferred 
before the lapse of Time tlO are transferred between Time tlO to Time til. By being 
completely transferred by Time tlO, the audio of the Program 2 is not transferred at this stage. 
The program components to be transferred between Time tlO to Time tU are the ones having 

10 the transfer priority of 2 in the storage list of FIG. 12. 

After Time til, video begins to be transferred. First of all, the digest video Dl of the 
Program 1 is transferred. The digest video is equal to the detailed video in the sense but has 
less information. Having less information means a state, for example, in which on-screen 
resolution is low or time-axis resolution is low, for example, a frame in a few seconds. 

15 When encoding of the detailed video is hierarchical encoding such as resolution 

scalability defined in MPEG-2 Video, for example, where videos in a plurality of layers are 
included in codes, data of the digest video can be obtained by selectively extracting the codes 
in a particular layer. Further, encoding by a hierarchical transfer method can be done in a 
similar manner to the hierarchical encoding. Alternately, in a case where a scene being a part 

20 on the time-axis of the program is specified by program index codes which are adopted in the 

digital broadcasting system in Japan, only the video in one or more scenes that is specified by 

the index as being more important can be taken out as the digest video. In this case, the 

remaining scenes do not have video data. However, by displaying the last fi-ame having the 

video data or by blacking out, it can be regarded as one program component in series. 

25 The videos are transferred between Time tl 1 and Time tl2. In detail, the detailed 
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video is transferred to the Programs 2 and 3, and the digest video being similar to the detailed 
video in the sense but having less information is transferred to the Program 1 . The videos 
become available to some extent for every program at Time tl2. The program components to 
be transferred between Time tl 1 and Time T12 are the ones having the transfer priority of 3 
5 in the storage list of FIG. 12. 

Lastly, the detailed video VI of the Program 1 beings to be transferred from Time tl2. 
For the transfer that is started from Time tl2, the program components having the transfer 
priority of 4 in the storage list of FIG. 12 are transferred. It is herein assumed that the detailed 
video VI of the Program 1 was supposed to be completely transferred by Time 1 13 but was 

10 interrupted at Time tb exactly at the halfway between Time 1 12 and Time tl 3. If this is the 
case, as to the program components in the "display" class of the Program 1, the digest video 
is wholly transferred but the detailed video is only half-transferred, i.e., only the first-half of 
the detailed video is transferred. Even if data transfer is interrupted due to such eventuality, 
the users can enjoy the program with video to some extent because the video information is 

15 already provided to every program to some extent. Further, even if the data transfer is 
interrupted at an earlier stage, the users can enjoy the program with closed caption 
(additionally, audio). 

FIG. 12 is an exemplary storage list which is to be generated in a case where the 
received data includes a digest video in the main device 1 of FIG. 1. In FIG. 12, the Program 

20 1 has the digest video in the program component (the third line of the storage list; in the 
receipt list, the sixth program component to be received). Accordingly, in the processing 
described in FIG. 4 where transfer priorities are determined (step S206), there is a digest 
video having the top transfer priority which is defined for the "display" class. Consequently, 
the processing of step S207 which re-writes the transfer priorities is not executed. Therefore, 

25 the digest video "D" and the detailed video "V", both of which are the types of the program 



components which are classified into the "display" class, are set to the transfer priorities by 
default. Further, as the Program 2 does not have closed caption having the top transfer 
priority defined for the "script" class, by step S207, the transfer priority of audio "A" is 
changed into the value of 1 which is defined as being the top priority for the "script" class. 
5 FIG. 1 3 is an exemplary receipt list which is to be generated when the data that is 

transferred from the main device 1 to the portable device 2 of FIG. 1 includes a digest video. 
In FIG. 13, as to the Program 1, the portable device 2 receives the entire digest video of 30 
minutes, but receives only the first-half of the detailed video of 15 minutes. In this manner, in 
step S406, the detailed video reaches to the tail of data 15 minutes after the start of play-back 

10 of the detailed video and audio in the play-back processing of the program described in FIG. 
8 (step S405) . Thereafter, the digest video being the program component in the "display" 
class after the lapse of 15 minutes is found in step S407, and then is stated to be played-back 
as a replacement for the detailed video in step S410. The play-back image of the Program 1 is 
accordingly lowered in quality after the lapse of 15 minutes from the start, but, is still 

15 sufficient for the users to enjoy the program. 
Second Embodiment 

FIG. 14 is an outer perspective diagram showing the physical structure of a portable 
viewing/listening system according to a second embodiment of the present invention. Further, 
FIG. 15 is a block diagram showing the electrical structure of the portable viewing/listening 

20 system according to the second embodiment of the present invention. By referring to FIGS. 
14 and 1 5, the main device 1 includes a processing part la, a charging part lb, and a cradle- 
type box Ic (hereinafter, refer to as cradle) onto which the portable device 2 can be placed. 
The portable device 2 includes a processing part 2a, a battery 2b, and a connection contact 2c. 
The processing part la is similar in structure to the main device 1 shown in FIG. 1, and the 

25 processing part 2a is similar in structure to the portable device 2 shown in FIG. 1. 



By placing the portable device 2 on the cradle Ic, the portable device 2 is electrically 
connected to the main device 1 via the connection contact 2c. Furthermore, in the meantime, 
the charging part lb which is provided in the main device 1 charges the battery 2b in the 
portable device 2 through the connection contact 2c. As the portable device 2 is relatively- 
5 high power, a rechargeable so-called secondary battery is popular for the battery 2b provided 
therein. Consequently, the battery 2b needs to be regularly charged every day, and this thus 
necessitates the portable device 2 to be physically connected to some types of charger. 
According to the second embodiment, when any physical connection for the to-be-required 
charging is made, information such as programs can be advantageously transferred at the 

10 same time. Therefore, rather conveniently, there is no need to make any new connection for 
transfer. Note that the charging part lb may monitor charging current and detect the start of a 
connection, and then notifies the detection to the processing part la so as to start the transfer 
processing of the program. In this manner, rather conveniently, program transfer is 
automatically started by only placing the portable device 2 on the cradle Ic. 

15 Third Embodiment 

FIG. 16 is an outer perspective diagram showing the physical structure of a portable 
viewing/listening system according to a third embodiment of the present invention. By 
referring to FIG. 16, in the portable viewing/listening system of the third embodiment, data 
transfer from the main device I to the portable device 2 is done indirectly via a recording 

20 medium 3. To be more specific, the recording medium 3 is written with information such as a 

program when being attached to the main device 1, and is read out the internally-stored 

program information, for example, when being attached to the portable device 2. In such a 

manner, in the third embodiment, program transfer or information exchange can be done in a 

similar manner to the first embodiment via the recording medium 3. The recording medium 3 

25 includes a hard disk card or a semiconductor recording card in PCMCIA Standards, for 
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example. 

In the third embodiment, the main device 1 is provided with a digital broadcasting 
receiver which is equipped with a slot of DVB-CI (Digital Video Broadcasting - Common 
Interface) . The DVB-CI is a specification that is standardized by the standardization group in 
5 Europe called DVB, and specifies the receiver to be equipped with a slot of PCMCIA and the 
slot to be an insertable type for a descrambler of a PC card in PCMCIA Standards. 
Accordingly, with a plurality of slots provided and a plurality of descramblers inserted, the 
receiver can correspond to various cryptographic methods. For the DVB-CI, PCMCIA which 
is normally equipped with a note-type PC (Personal Computer) as a physical and electrical 

10 interface is used. For some receivers, it is structurally possible to function in a similar manner 
to the main device 1 in FIG. 1 only by updating a software in the existing digital broadcast 
receiver by way of a download through broadcasting. 

In the third embodiment, the portable device 2 is the note-type PC. Thanks to the 
improving-performance of the CPU, for example, the video and audio of the MPEG-2 can be 

15 decoded only through software processing. Therefore, only by installing a computer program 
which executes the processing for the portable device in the existing-type of the note-type 
PC, an operation similar to that of the portable device 2 can be attained. Note that the 
aforementioned computer program is written to the recording medium 3 by the main device 
1, for example, and then is read out by the portable device 2 and executed. In such a manner, 

20 there is no need to have a special operation in which the program is downloaded from the 
network so as to obtain the program in the portable device 2. 
Fourth Embodiment 

FIG. 17 is a block diagram showing the structure of a portable viewing/listening 
system according to a fourth embodiment of the present invention. In the fourth embodiment, 

25 it is assumed that an information source for the main device 1 is not broadcast but is 



broadcast-type service from a computer network 4 such as Internet. 

In the fourth embodiment, the main device 1 is provided with a modem Id, a PC 
(personal computer) le, and an MD (Mini Disk) deck If which is used to exchange data in the 
computer network 4. The modem id, PC le, and MD deck If are interconnected through a 
5 high-speed digital interface such as IEEE1394. In this example, the PC le functions in a 

similar manner to the main device in FIG. 1 by executing a predetermined computer program. 
The recording medium 3 may include a package medium such as MD. 

In the fourth embodiment, the portable device 2 is structured as a audio-playback- 
capable digital still camera including an MD drive 2d, a photographing part 2e, an encoding 

10 part 2f, a reproduction (play-back) part 2g, a display 2h, a speaker 2i, and a CPU 2j. Note that 
the CPU 2j controls an operation of a predetermined circuit block (for example, the MD drive 
2d, the photographing part 2e, and the encoding part 2f). By operating the CPU 2j which is 
provided for the digital still camera in accordance with the predetermined computer program, 
the digital still camera is structured to function in a similar manner to the portable device 2 in 

15 FIG. 1 in addition to a typical function for a general camera. Note that the recording medium 
3 is not limited to the MD. Further, the portable device 2 may directly receive data from the 
main device 1 in a structure where the main device 1 is connectable to the portable device 2. 

In the embodiments described above, every program data that is stored in the main 
device 1 is set to be transferred to the portable device 2. However, only the program data 

20 which is selected by the users from among the program data that is stored in the main device 
1 may be transferred to the portable device 2. If this is the case, the EPG (Electric Program 
Guide) data may be previously transferred from the main device 1 to the portable device 2, 
and then the users may preselect any program data which are desired to be received from the 
main device 1 while taking a look at the program guide at their convenience. In detail, the 

25 main device 1 recognizes the programs that are preselected in the portable device 2 when the 



portable device 2 is attached thereto, and then transfers only the applicable program data to 
the portable device 2. 

INDUSTRIAL APPLICABILITY 
The present invention is suitable for a case where a program that is received by a main 
5 device and stored therein is to be easily enjoyed with a portable device. 
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